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Q ■ Abstract. In this paper, Cramer type moderate deviations for the maximum of the 

^ I periodogram and its studentized version are derived. The resuhs are then apphed to 

bX). a simultaneous testing problem in gene expression time series. It is shown that the 

^ • level of the simultaneous tests is accurate provided that the number of genes G and 

O ! the sample size n satisfy G = exp(o(?T,^/'^)). 
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^ ■ 

1 Introduction 

^ ^ Let Xi, X2, ■ ■ ■ be a sequence of random variables. Define the periodogram ordinates 

•/^ ! for {Xn} at the standard frequencies ujj = 27Tj/n by 



00 ■ n\ ^ 

o ■ 

O ■ where 1 < j < g and (l=\{n — l)/2] 

The periodogram is a fundamental tool in spectral analysis and is often used to 
^ \ detect periodic patterns in various real applications, such as the analysis of gene ex- 

pression data and the study of earthquake. Theoretical properties of the periodogram 
have been extensively studied. An, Chen and Hannan (1983) obtained the loga- 
rithm law for the maximum of the periodogram; Davis and Mikosch (1999), Mikosch, 
Resnick and Samorodnitsky (2000), Lin and Liu (2009a) obtained the asymptotic 
distribution for the maximum of the periodogram under the i.i.d. and linear pro- 
cess cases, the heavy-tailed case and nonlinear time series case respectively; Fay and 
Soulier (2001) obtained central limit theorems for functionals of the periodogram; 
Shao and Wu (2007) obtained asymptotic distributions for the periodogram and em- 
pirical distribution function of the periodogram for a wide class of nonlinear processes. 
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When {Xn} are independent and identically distributed (i.i.d.) random variables with 
Var(Xi) — (7^ and E|Xip+'^ < oo for some S > 0, Davis and Mikosch (1999) shows 
that 

lim P( max In{uJj)/a'^ - logg < y) ^ exp(- exp(-y)). (1.1) 

n— ►oo \ l<j<q / 

The main purpose of this paper is to study the Cramer type moderate deviations 
for the maximum of the periodogram and its studentized version. That is, what is 
the largest possible a„ so that 

P ( maxi<j<q In{ujj)/a'^ - log q>y] 

2^ L ^ I n 2) 

1 - exp(-exp(-y)) 

uniformly in y e [— log a„], or for the studentized periodogram, what is the largest 
possible hn so that 

1 - cxp(-exp(-y)) 

uniformly in y G [— log g, We shall show that a„ depends on the moment condition 
of {Xn}. For example, if E|Xip+'' < oo, (5 > 0, the largest possible value of a„ is 
I log n, but a„ can be chosen o{n}/^) if the moment generating function of Xi is finite. 
However, the situation becomes totally different for the studentized periodogram. We 
shall prove that 6„ = o(n^/^) provided that EX^ < oo. 

The paper is organized as follows. Our main results. Theorems 2.1-2.3, are stated 
in Section 2, while proofs of the main results are postponed to Section 4. Our moderate 
deviation results are motivated by simultaneous tests in gene expression time series. 
Theoretical results for the simultaneous tests and simulation study are discussed in 
Section 3. 



(1.3) 



2 Main results 

Throughout this paper, we assume {Xn} are i.i.d. random variables. Our first result 
is the moderate deviation for the maximum of the periodogram for y < clogn for 
some c > 0. Such type of moderate deviation for the partial sums of {X„} has been 
studied in literature, e.g. by Michel (1976), Amosova (1982), Petrov (2002) and Wu 
and Zhao (2008). 

Theorem 2.1 (i) Suppose that for some c> 0, 

n"+^P(^|Xi| > V^logn) = o(l) (2.1) 
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as n ^ oo. Then we have 



P( maxi<j<g/„(u;j)/(T^ - logg > y) 

lim ^ ^ = 1 (2.2) 

1 - exp(-exp(-y)) 



n— >oo 



uniformly in y & [— logg, clogn], where cr^ = Var{Xi). 

(a) If for some cr > li2.S\) holds uniformly in y E [—logg, clogn] with some 
c> 0, then we have 



p[\Xi\ > ^Jn logn) = 0(1). (2.3) 



Theorem 2.1 (ii) shows that condition (12. ip is nearly optimal and hence the range 
depends on the moment assumption. On the other hand, when the moment generating 
function exists, the range can be extended to o{ri^l^). 

Theorem 2.2 Assume \/ar{X\) = cr^ and Ee*"''''"^' < oo for some to > 0. Then 



p(^maxi<j<g Iniujj) / a"^ - logg > y^ 



lim 

n^oo 1 — exp(— exp(— ?/)) 

uniformly in y E [—logg, o{n^^^)). 

We next consider the maximum of the studentized periodogram. Theorem 2.3 
below shows that the moment conditions in Theorems 2.1 and 2.2 can be significally 
reduced for the studentized version. 

Theorem 2.3 If EXf < oo, then 

lim J_ ^ 1 (2.4) 

n^oo 1 — exp(— exp(— y)) 

uniformly in y E [—logg, o{n^^^)). 

Since the variance cr^ of Xi is typically unknown, what used in practice is actually 
the studentized periodogram. So the result in Theorem 2.3 is more appealing and 
useful than Theorems 2.1 and 2.2. Theorem 2.3 also shares similar properties with self- 
normalized partial sums of independent random variables, which usually requires much 
less moment assumptions; see, Shao (1997,1999) for self-normalized large deviation 
without any moment assumption and Cramer moderate deviation under finite third 
moment and de la Pena, Lai and Shao (2009) for recent developments in the area of 
self-normalized limit theory. In view of the moderate deviation for self- normalized 
partial sums (Shao (1999)), we conjecture that Theorem 2.3 remains true if E|Xi|^ < 
oo. 
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3 Application to simultaneous tests 



3.1 Theoretical results 

Periodic phenomena are widely studied in biology. Recently, there are quite a lot of 
interests in detecting periodic patterns in gene expression time series; see Wichert, 
Fokianos and Strimer (2004), Ahdesmaki et al. (2005), Chen (2005), Glynn, Chen 
and Mushegian (2006) and the references therein. Due to modern technology such as 
microarray experiments, the data are usually high- dimensional and we often need to 
make many statistical inference simultaneously. Let Yf g denote the observed expres- 
sion level of gene g at time t, 1 < g < G and I < t < n, where G is the number of 
genes. The sample size n is usually much smaller than the number of genes. Consider 
the following model of periodic gene expression 

Yt^g = Hg + pgCos{ujt + (p)+et,g, (S.l) 

where Pg > 0, u E {0,7i), (f) E {—11,71], fig is the mean expression level. For each 
g, Ei^g, ■ ■ ■ ,en,g are i.i.d. noise sequence with mean zero. We wish to test the null 
hypothesis H^g : Pg = against the alternative hypothesis Hi g : f3g ^ If HQ g is 
rejected, then we identify gene g with a periodic pattern in its expression. Periodogram 
is often used to detect periodically expressed gene. Let 

^^^(^^■) = ^|En,,e^'"^ (3.2) 



k=l 



where Uj = 2Trj/n, I < j < [{n — l)/2]. Define the (/-statistic 

and its null distribution Fn^g{x) = P{fg < x\HQg), where q = [{n — l)/2]. Under 
the null hypothesis and the assumption that ei^g,--- ,en,g are i.i.d normal random 
variables, the exact distribution for fg can be found in Fisher (1929): 

P(/, > x\H,,g) = f^(-l)^-iC^(l - jxy-' =: Ux), (3.3) 

where p = [1/x]. Using (13.31) . Wichert, Fokianos and Strimer (2004) proposed the 
following method to identify periodically expressed genes: 1. For each time series 
calculate Fisher's statistic fg. 2. For each of the test statistic calculate the corre- 
sponding p value Pg = fnifg)- 3. Use the method of Benjamini and Hochberg (1995) 
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to control the False Discovery Rate (FDR) at 9. Consider the set of ordered p values 
^(1), ■ ■ ■ ,P{G) and let 



ie = max{z : P(i) < iO/G}. (3.4) 

Reject the null hypothesis for the time series indexed hj S = {i : Pi < P{ig)}- 

In many applications such as those arising from bioinformatics, the noise can be 
remarkably non-Gaussian (Ahdesmaki et al. (2005)). Then the values Pi, ■ ■ ■ , Pq are 
only the estimators of the true p-values. It is natural to ask: 

How large G can be before the accuracy of simultaneous statistical infer- 
ence becomes poor? 

Similar problems have been studied in Fan, Hall and Yao (2007), where they consider 
yt,g = /^g + £t,g, the model in (13.11) without periodic parts, and focused on testing 
Ho,g : = 0. Let the true p value be = (1 - KMg))- F^om ([331), ^^y 
be of the order 0{1/G). Hence maxi<g<G |Pg™^ — Pg\ = o(l), implied by (11.11) . is not 
enough. The required accuracy between the estimated p value and the true p value is 

|P, - P*™V{^<;} = o{P'Jn uniformly ml< g<G, (3.5) 



I.e. 



max 

1<9<G 



P 



9 



ptrue 
9 



1 



i{n,} = 0(1) 



where Hg = {Pg > 9/{2G) or P^*™^ > 9/{2G)}. (On Wg, the gene g is always rejected.) 
Some similar requirements as (13. 5p on simultaneous tests have been proposed by Fan, 
Hall and Yao (2007) and Kosorok and Ma (2007), p. 1460. 

Recall that Fn^g{x) = P{fg < x\HQg). By examining the proof of Theorem 2.3, we 
can get the following corollary. 

Corollary 3.1 Suppose that mini<g<G' Var{ei^g) > k for some n > which does not 
depend on G. Further assume that ma.xi<g<G Eef g = 0(1). Then the null distribution 
Fn,g{x) satisfies 

1- Fn,g{{y + log q)/q) 



max 

1<9<G 



1 - exp(-exp (-?/)) 
uniformly in y E [— logg, o{n^^^)). 



o(l) 



The following lemma shows that we can replace 1 — exp(— exp(— y)) by fn{{y + 
logg)/g). 
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Lemma 3.1 We have 

fniiy + '^ogq)/q) 



lim 



0, 



1 - exp(-exp(-y)) 
uniformly in y E [— logg, o{n^^^)). 

It follows from Corollary 3.1 and Lemma 3.1 that 

Theorem 3.1 Suppose the conditions in Corollaru \3.1\ are satisfied andG = exp(o(n-'^/^)). 
Then (E^ holds. 

Theorem 3.1 shows that the level of the simultaneous tests is accurate provided 
that G = exp(o(?7,^/'^)), which seems to be the correct order of asymptotics for mi- 
croarray experiments with a moderate number of samples. 

Using the bootstrap and a refined expansion of t-statistic in Theorem 1.2 of 
Wang (2005), Fan, Hall and Yao (2007) shows that exp(o(?2^/'^)) can be replaced 
by exp(o(n^/^)) for the tests H^g : fXg = 0. It would be interesting to investigate 
whether a similar expansion as Theorem 1.2 of Wang (2005) holds for the maximum 
of the studentized periodogram. 



3.2 Simulation study 

In this section, we carry out a simple simulation study to assess the finite sample 
performance. We generate 2000 genes with 100 periodic genes for different sample 
sizes n. Consider 

Yt^g = (3{cos{uj^'^h) + sm{uj^^h)) + et,g, I <t<n, l<g< 100, 
Yt,g = et,g, l<t<n, 101 < ^ < 2000. 

€t,g will be taken as A^(0,1), x t(5), EXP(l), 2'^ x x^(2), where t{5) has 

the t distribution with freedom 5, EXP(l) is the exponential random variable with 
parameter /i = 1, X^(2) is chi square random variable with freedom 2. (The constants 
on the left hand side of random variables are chosen so that \/ar{et,g) = 1). The FDR 
level 6 is chosen as 0.15 and 0.05. The simulation results are based on 100 replicates. 

We only give the simulation study when cu^^^ is of the form of tOi for some 1 < 
i < q. To do this, we let cu^^^ = 271/10, n = 20,50 and /? = 1. The results are 
summarized in Table 1, where Tot.=total count identified using FDR; Pos.= the 
number of true positives identified using FDR; Z=the number of true periodic genes 
among the smallest 100 p-values genes. We note that when the tails of et^g are heavier 
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than that of Gaussian random variable, the empirical FDR (EFDR) are lower than the 
target FDR, while most of periodic genes can still be found. There are no significant 
differences between Gaussian noise and other noises when n is large moderately {n — 
50). Powers increase as n increases. Overall Fisher's statistic is relatively robust to 
the noise, as indicated by our theorem. We refer to Wichert, Fokianos and Strimer 
(2004) for some real data analysis. 



Table 1: 



e 




Tot.(Pos.) 


EFDR 


Tot.(Pos.) 


EFDR 






n = 20 




71 = 50 




0.15 


Normal 


39.9(33.7) 


0.155 


116.2(99.6) 


0.143 


0.05 




12.6(11.9) 


0.059 


102.6(99.2) 


0.033 


z 




62 




97.1 




0.15 


EXP(l) 


55.3(49.5) 


0.105 


104.3(97.3) 


0.067 


0.05 




33.1(31.9) 


0.036 


97.8(95.8) 


0.020 


z 




69.5 




96.9 




0.15 




46.0(43.2) 


0.061 


105.0(97.6) 


0.071 


0.05 




29.0(28.2) 


0.028 


98.1(95.6) 


0.026 


Z 




69.7 




96.5 




0.15 


t(5) 


43.4(39.7) 


0.085 


110.2(98.2) 


0.109 


0.05 




20.2(19.6) 


0.030 


99.9(96.6) 


0.033 


Z 




67.6 




96.6 





4 Proofs 

Throughout, we let C denote positive constant, and its value may be different in dif- 
ferent contexts. For two real sequences {a„} and {&„}, write a„ = 0{bn) if there exists 
a constant C such that |a„| < C|6„| holds for large n, an = o(6„) if lim^^oo ctn/^n = 0. 
We denote by | • | the d-dimensional Euclidean norm in d>l. 

Proof of Theorem 2.1. (i) (Sufficiency) By ELi e''"^' = for 1 < j < we 

can assume that EXi = 0. Also, for convenience, we assume cr^ = 1. For y e 



[— logg, clogn], set x = y/y + logg. Wc start with trunction of X^. at two levels. Let 
En = (logn)~^ and e > be a small number which will be specified later. Define 

Xk^X',-EXl X',^XkI{\Xk\<eV^x}, 
Xk = < - EXl Xl = XkI{\Xk\ < SnV^/x}, 

-i n- 2 1 " 



n I 

k=l k=l 
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1 " 2 1" 



fe=i 



k=l 



(4.1) 



Then we have 

P( max In(i^i) > x^] — Pi max > x^) 

\i<j<q ^ ■'^ - J \l<j<q -^^ - J 

< nP(^\Xi\ > ey/^xy 
The independence between Xi and {X^, k ^ I}, 1 < I < n, imphes that 
P( max I„(uji) > x^] — P( max I„(uji) > x^] 



(4.2) 



max 
i<i<g 



n 



A;=l 



max 

1<J<9 



ikiOi 



> (1 - £)v^a;^P^|X;| > £„v^/a;^ 



< nP ( max Xj^ 



^ikuij 



(1 - 2£)Vna;)p(||Xi| > EnVn/x^ 
< nP(^ max | ^X^'e^*^'"^ > (1 - 2£)Vna;) P(||Xi| > £„V^/x) 

~ ~ k=l 

+ (nP(^\Xi\ > SnVn/x^^ 
-.A+ (nP(^\Xi\ > EnVn/x^y. 



k=l 



(4.3) 



To estimate A, we need Lemma 4.2 of Lin and Liu (2009a). The proof is given in 
Lin and Liu (2009b), pages 23-25 and the constants no, C, ci,i, • • • , ci,3 below are 
specified in Lin and Liu (2009b). 

Lemma 4.1 [Lin and Liu (2009a,h)] Let ^ri,i, ■ ■ • )Cn,fe„ be independent random vec- 
tors with mean zero and values in I^'^ , and Sn = Yl!ili^n,i- Assume that \in,k\ < 
CnBn"^ , I < k < kn, for somc c„ — >• 0, i?„ — >• oo and 

B-^Cov{^n,l + ■■■ + ^n,kj - hd\\ < Cocl 

where l2d is a 2d ^ 2d identity matrix and Cq is a positive constant. Suppose that 
(5n '■= Bn^^^ Sfcli f^lCn.fcl"^ ~^ 0. Then for all n > Hq (uq is given below) 



\P{\\S4a>x)-Pi\\N\U>x/By')\ 
<o(l)P(||Ar||,>x/Sy2)+c(exp(- 



5>in(c-^/3-'/^) 



16d J ■ ypi\og(3n 

uniformly for X G [Bn^ ,SnJ^iTL{c~ \(3n'^'')Bj/^], with anySn — > and 6nTam{c^^ , j3n ) 
oo. N is a centered normal random vector with covariance matrix l2d- \\'\\d is defined 
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by \\z\\ii = min{(x^ + : 1 < « < d}, z = {xi,yi,--- ,Xd,yd)- \\ ■ \\ is the spectral 

norm for the matrix. C is a positive constant which depends only on d and Cq. o(1) 
is bounded by Ci^i(5^ + Pn + c„), Ci^i is a positive constant depending only on d. 



no = mill |n : VA; > n, < 



-, 5fc < Ci,2mm(Co 2^ 1), < ci^sj, 



where Ci^2 o,nd ci^s are positive constants depending only on d. 

Let c? > 1 be a fixed integer and 

Yfe := Yk{ui-^, ■ ■ ■ , UiJ 

= Xk(^cos{kuJiJ,sm{kui^), ■ ■ ■ ,cos{kuiJ,sm{ku,^j j, 
1 < k < n, 1 < ii < ■ ■ ■ < id ^ Q- 

Let ll^lld = min{(x^, + ylY^'^ : 1 < k < d} with z = {xi,yi, ■ ■ ■ , Xd, yd)- By the facts 
that for 1 < j, / < g, 

n n n 

'^^cos'^{ujjk) = n/2, ''^^ sin^ (ujk) = n/2, cos{u! j k) sm{u ik) = 0, (4.4) 

k=l 

we can see that 



k=l 



k=l 



n 



n ^ 

iCov(^Y,) - -hd\\ < EX2/{|Xi| > £„v^/x}, 

k=l 



(4.5) 



where l2d is 2d x 2d identity matrix and || ■ || is the spectral norm. It is easy to see 
that ( 12. ip implies E|Xi|^ < oo for any 2 < p < 2c + 2. Thus we have 

n 

\Yk\ < 2denV^/x and n'^/^ ^ E\Yk\^ < C msix{n^-P/^x-'^+P ,n-^/^). (4.6) 

k=l 

Letting c„ = 2e„(logg)~^/^, i?„ = n in Lemma WA] and (5„logn oo with Sn being 



defined in Lemma 14. ![ we have for any < < 1 , 



p{\\Ek=i^k\l>a-v)V^x) 

exp(-d(l - ri)^y) ' ^' 



(4.7) 



uniformly in x G [-y/log g, a/(c + 1) logn]. Observing that 

1 " 2 

^n(^.) = -(||EY.K)|L) ' 

k=l 

by m, 

g n 

P(maxj:(a;,)>x2) < J] P (|| Yfc(^,) ||^ > v^x) < (1 + o(l)) exp(-|/) 



fc=i 



uniformly in y E [O,clogn]. So, combining (I4.2l) - (l4.7p . we prove that 
Pf max In{ujj) > x^] < (1 + o(l)) exp{-y) 

V l<j<q / 

+Cn^+^' exp{-{l - 2efy)p(^\Xi\ > e„v^/x^ 
+ (nP(^\Xi\ > e^^/^/x^y + nP(^\Xi\ >£v^x),(4.8) 

uniformly in x G [-y/log g, a/(c + 1) logra]. To establish the lower bound, we observe 
that 



P 



= P( max I„(uJi) > X 
\i<i<n J' — 



-pf max I';^{u0j) > x2,U^^i{|Xfc| > e„V^/x}) . (4.9) 
Similarly to (14. 3p and by (14 .Tp . we have 

P( max Ciu,) > x^ULl{|^fc| > SnV^/x}) 

n 

< r2P(^ max | ^X^'e^^"^^ > (1 - 2£)v^a;) P(|Xi| > £„v^/x) 

~ ~ fc=i 

< Cn^+^' exp{-{l - 2eyy)p(^\Xi\ > £„v^/x) (4.10) 



uniformly in x G [i/log g, ^/(c + 1) logn]. For the first term in ( ]4.9p . we have 

P(max/:(^,)>x2) >^P(A,)- J] P(A,A,), (4.11) 

j=i i<i<j<g 

where Aj = {l'^{iUj) > x'^}. Applying d = 1,2 in (14.71) respectively, we obtain 

P{Ai) = (1 + o(l))g-i exp(-y), P{AiA,) < Cn-'' exp(-2y), 

uniformly in 1 < z,j < g and y G [O,clogn]. These two inequalities together with 
M-l lCTD yield that 

pf max /„(tu,) > a;^) > (1 + o(l)) exp(-y) - C exp(-2?/) 

V l<j<q / 

-Cni+4^exp(-(l - 2efy)p{\X^\ > £„v^/x) ,(4.12) 
uniformly in y G [O,clogn]. It is easy to see that (12. 1|) implies that 



pflXil > EnVn/x^ < C- 
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for En = (logn) ^ and x G [\/\og q, a/(c + 1) \ogn]. Hence, by f l4.8p . fl4.12p and for e 
sufficiently small, we have for any M > 0, 



lim sup sup 

n^oo M<y<clogn 



P(^maxi<j<gln{ujj) -\ogq>y 



1 - exp(-exp (-?/)) 
By f ll.ll) . we have for any fixed ?/ G R, 

P( max -\ogq>y) ^ 1 - e" 

V i<j<o / 



< Ce 



-M 



(4.13) 



Thus, it follows that 



lim sup sup 

n^oo — logg<y<M 



P(^maxi<j<g J„(cc'j) - logg > 
1 - exp(-exp (-?/)) 



0. (4.14) 



This proves (i) by (HA3|) and (ITOj) . 
(ii) (Necessity) By (1^ . we have 

Pf max I y XfcC^^^^ > av/(l + c)nlogg) < C 

This implies that 

pf max I 

V l<j<q I ^ 



k=l 



ikujj 



k=l 



> 2"Vv/(l + c)n log g) < Cn 



(4.15) 



where = X„ — and {X^} is an independent copy of For z 

ZqA,Zn,2) & R^^ let 



l^l|max — max xjzj-^ + 2;?2- 



For 1 < /c < n, let 



Dfc = {Xlcos{kuJi),Xlsm.{kuJi),- ■ ■ ,Xlcos{kujq),Xlsvii{kujq)). 



Then it is easy to see that maxi 



ELiI^fcllmax- By Levy's 



k=l^k<^ ' 

inequality in a Banach space (cf. Ledoux and Talagrand (1991), p. 47) and (14.151) . 
we have 



P( max ||Dfc||max > 2 Va/(1 + c)nlogg) < Cn ^ 

\ l<A;<n / 

Observing that ||D,fc||inax = we have by (14.161) . 

1- (l- P[\X'^\ > 2-^ay/{l + c)n\ogq^y < Cn-^ 



(4.16) 
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which imphes that 

1 - exp - nP(^\X'^ \ > 2"Vv/(l + c)nlogg)) < Cn-". (4.17) 
Now (12. 3p follows from (14.171) and some elementary calculations. □ 

Proof of Theorem 2.2. For any e'^ 0, let x = y/y + logg G [4, e^n"^/^] and 
En = En^- Define 



1 I " 

k=l 

Then, by Lemma 4.2 below (taking N/ = and d = 1), we have 

q n 

P( max /:(.;,) > x^) < J] P(| J^Xle^'^-^ | > v^x) < (1 + o(l))e-^ 



3=1 k=l 



uniformly in a; G [4,£>i/% Since Ee*ol^il < cx), we have nP^|Xi| > En\/n/x^ = 
0(1)6^"^^. Therefore, 

max In{oJj) > x^j < P^ max I^i^j) > + nP(^\Xi\ > En\^/x'^ 

< (1 +~o{i))e-y 

uniformly in x G [4,e^n^/^]. Similarly, we have 

P( max In{ujj) > x^^ > (1 + o{l))e-y - Ce^^^ 

uniformly in x G [4,e;,ni/% The remaining proof follows similar arguments as in the 
proof of Theorem 2.1. □ 

Proof of Theorem 2.3. Recall that Y2=i = for 1 < j < g. Without loss of 
generality, we can assume that EXi = and EX^ = 1. By the fact e*'^'^^i = e'^'"^^^ for 
ji + j2 = n, we have 



k=l k=l 

for ji + j2 = n. Hence, when n is odd. 



g-^^4(^,) = (2g)-i^(j„(^,) + /„(^„_,)) 

n 

{2qr'Y.^^{uj,)--^^(X)\ (4.18) 
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where X = n 22k=i -^k- Moreover, 



n n n k—1 n 

j=l k=l k=2 1=1 j=l 



where Wk,ij = cos{ujjk) cos{uJji) + sm{ujjk) sm{ujji). Note that ujk = ujkj and ujji = 
Uij. Since |^/Lie*''^| = | sin(An/2)|/| sin(A/2)| when A/tt is not an integer, we get 
YTj=i'^k.i.j = J2]j=i cos{{uJk — = 0. So, ( 14.18P imphes that, when n is odd. 



q - 7 Jn[uJj} = (n- 



n 



k=l 



Similarly, when n is even, we have 



q-' = {n- 2)-i {Y^k- n{Xf - n{X f) , 

j=i k=i 



(4.19) 



/ 

where X = Sfc=i(~l)'^^A:- By the self-normalized moderate deviation Theorem 
3.1 in Shao (1997), we have 



n n 
fc=l A:=l 



^2/3/4 



where = ELi^l- view of fHlSD and fICTD . it suffices to show that 



lim 

n^oo 



^maxi<j<g 



log g > y 



(4.20) 



1 - e-^"" 

uniformly in ?/ G [— logg, o{n^^^)). 

Let A = A„ be a positive number which will be specified later. Let H be a subset 
of {I,-- - ,n}. Put 

Xl = XkI{\Xk\<X}, l<k<n, 



Mn = max > XfcC 
i<i<9 I ^ 



fc=l 



M„ = max V X'^e 



k=l 



Mi") = max 
i<i<'? 



J2 Xkc'^'^^ 



k=lMii 



, Mi") = max 

i<j<q 



,ikuJi 



A:=l,fc^H 



fc=l,A:^H fe=l,fe^H 



fe=l 



Noting that for any real numbers s and t and nonnegative number c and x > 1, 

{s + t> xVc + t^} C{s> Vx^ - ly/c}, (4.21) 
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(see p. 2181 in Jing, Shao and Wang (2003)), we have 

a 

P{Mn>xVn) < P{Mr,>xVn)+Y.^{Mr,>xVn,Xj^X'^ 

i=i 

n 

< p(m„ > xVn) + ^ p(m(^) + \Xj\ > xVn, Xj ^ 

n 

< P{Mr,>xVn)+J2P (m(^) > V^^Fi^) , Xj + 

n 

= p (m„ > xk) + ^ p (|x,| > a) p [m^^ > V^2^v;(^)) (4.22) 

Repeating the above arguments m times with m — [x'^/2\, we have for x > A, 

n 

jl=l 

n 

Jl=l 

+ EEp(|^^iI ^^)P(^n^'''^ ^^^^^^i^^^^^^^ 



ii=ii2=i 



(4.23) 



where 



n n 



n n m+1 

ji=l jm+i=l k=l 



0] 

For £^ — > and 4 < x < £^n^/^, let A = en\^/x, where = £n^^. Then 

^m+i < (^P(|^i| > a))™^^ < e-"^^''^^" = o(l)e-^', (4.24) 



where 



g„ = (^e'^e-'E\X,\'l{\X,\ > A})"' ^ oo 
as n — > oo. Let < I < m — [x^/2] and N; = {ji, • • • , J/} C {1, • • • , n}. Define 
Yfc = X^^cos(/ca;iJ,sin(A;a;iJ, • • • , cos{kuJi^) , sm{kujij^ , 
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1 < k < n, d> 1, 1 < ii < ■ ■ ■ < "id < (?. 

n n 
k=l,k(^'N, fc=l,fc^N, 

To estimate Zi, we need the following lemma. 

Lemma 4.2 Suppose that E\Xi\'^ < oo and < x < e^n}!^ , where ^ zs any 
sequence of constants. Let < Sn —>■ and En = Sn"^ ■ (i) If ^ = ^nV^/x, then we 
have 



lim 

n— ►oo 



N, 



> X\fn 



(4.25) 



uniformly in x G [A,e'^n^^^], I < ii < • ■ ■ < id ^ Q and < I < m. (ii) If X 
{en^fnjx)^!'^ and EXf < oo, then ( [^.^5p holds. 



Proof. Recall that ^2^=1 ^ ~ 1 < J ^ 9- We have for n large, 

n n 

I E = I J2 eyL < dxy2 < e^v^/x. 

k=l,k(^Ni 



keN, 



It follows that, for x E [A,e'j^n^^^], 



> xy/n + en\^/x] < P 



< p 



> xJn 



> x\/n — Snyn/x ). 



Since E|Xi|^ < oo, we have 



|Y^| < 2denVn/x and n'^/^ ^ E|Yfc|^ < Cn'^/l 



k=l 



Also, simple calculations show that 



n V 



I 



2d 



< £Xll{\Xi\ > A} + Qn-^x^ < Cxn^^'^e-^ < Cel/x'^ 



for 4 < X < e^n^/^. By taking c„ = 2den/x, Bn = i/n and 6n/Sn — ^ oo in Lemma WTi 
we have 



P( > Xy/n±en^/n/x 

V d 



-dx^ 



uniformly in x G [4,e>i/6]. This proves Lemma [4. 2 [ 
From Lemma [4.21 we have for < / < m = [x^/2]. 
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+ p(vin,-,h) < ^n(l - £„x-2)) 
= (1 + o(l))ge-^''+' + P(vi^'^'-'^') < v/ri(l-£„x-2)), (4.26) 

uniformly in x G [4,e^?2^/^]. By a similar argument as in Hu, Shao and Wang (2009), 
p. 1193, if EXf < oo, we have 

pfyUu-Ji) < ^n(l -£„x-2)) <p(n-mi- V^^^'- '^^^^ > e^nx'Vs) < o(l)e-^', 
where is the cardinality of {ji, ■ ■ ■ , j/}, and hence 

Zi < Cn(nP(^\Xi\ > A^jV^^'-') < Cne-^'+'-^'^^s"". (4.27) 
This together with g„ ^ oo shows that 

Y,Zi = o{l)ne-^\ (4.28) 

uniformly in x G [4, Combining (|122])-(|121!), (SSED and Km yields 

p(m„ >xV;) < (l + o(l))ge-^' (4.29) 

uniformly in x G [4, e'^n^^^]. 

We next estimate the lower bound for P^M„ > xVr^. For e'^-^ and 4 < x < 

e'j^n^^^, let = im.a.x{{x/y/nY^^,en^'^) and A = (£:„v^/^)^''''- Then 
p(m„>xK) > p(m„>xK) 

n 

-5^p(Mi^) > v/^^V;(^))p(|X,| > a). (4.30) 
i=i 

Similarly to (14.271) . we have 

n 

^ P(^M^^) > V^^!^^Vji^^^p(^\X^ \ > a) = o(l)ne-^' (4.31) 

uniformly in x G [4, e|^n^/^]. For the first term on the right hand side of fl4.30p . we 
have 

P(Mn>xK) > P{Mn>xVn,V^<n{l+en/x^)^ 

> p(m„ >xv/n(l + £„/x2)) 

-P(Mn > V^x,V^ > n{l + en/x^)y 
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Define A = {V,^ > n{l + ejx^)}. Set ^,,(^1, ^2) = cos{kwi) + 62 sm{kwi)) for 

any 61,62 G R. Let 

©1 = {^1 > 0, ^2 > 0; 6l + 61 = 1}; 62 = {^1 > 0, ^2 < 0; 6^ + = 1}; 
03 = {6^ <0,62> 0; 6l + 61 = 1}; 64 = {^1 < 0, ^2 < 0; 6l + 6i = 1}. 



Then we have 



q n 

<Vpf sup IVn/^1,^2) >v^x,a) 

" n 

Y,^kM,62)\>V^x,A^ 



+ p I sup 



+ Vpf sup |VnX^i,^2) >x/^a;,A) 

g n 

+y;p( sup \y2Yk,i{6i,62) >^/ex,a). 



(4.32) 



We only deal with the first term above, while other terms can be proved similarly. 
Let 6i^i = i/n^ for 1 < i < and 62,1 = Jl- .. We have, ior 1 < I < q, 



p( sup |Vn,K^i,^2) >v^x,a) 

n 



i=l A;=l 

„6 



,1 M('i,6'2)Gei,0i,i_i<ei<6ii,i ' ^^-^ 



«=1 i=l 



(4.33) 



Itiseasy toseethatsup(e^e2)Gei,ei,,_i<ei<ei,J^fc,K^i'^2)->^fc,«(^i,i5 6'2,i)| <n ^ Hence 
J2,i = for X e [4, e^n^/^]. Letting b = xl\Jn and r = {^/n/xy/^, we have 

n 

< P ( E ^2,^) + t6V„2 > - £„ + r(x2 + £„)) 

n 

+ P ( E 02,^ + ^^''K' > - £n + t(x^ + En)) 

k=l 
n 

< P ( E bYk,i{Oi,i, hi) + -^^'K - EVj] > - + T£„) 



fe=l 
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=■■ h,. (4.34) 

where 

en = £n + Tl?{n - EV^) = £„ + oiVfx^ / y/n. 

Let r^fc = YuM,^^ ^2,i) and ^fc = X'^ - EX'^. Using |e^ - 1 - s - sV2| < Ispe^^o, we 
get 

Eg26r,,.+2r62^,. _ I + 2E{hr]k + rh^ ^kf + 0{l)E\hr]k + rh^ ^k? 

= 1 + 262Er^2 ^ 4^53e(^^^^) + 2r264E42 + 0{l)e'{b'E\r^k? + r^^'Eie^H 
= 1 + 2h\EX',^ - {EX',f)[el, cos'ikwi) + el sm^kwi) 

+2ei.fi2,i cos{kwi) sm{kwi)] + 0(1) (1 + T)b^ 
= 1 + 2b'^{el- cos^{kwi) + el sm'^{kwi) + 26'i,i6'2,i cos{kwi) sm{kwi)) 

+0(l)(l + r)6^ 

for X G [4, e^n^/^]. This, together with ( 14.4p . imphes that 

JsA < 2exp(^-2a;2 + 2£„-2r?'„ + n6^ + 0(l)(l + r)xVv^) 

< C exp - b-^/^y (4.35) 

Combining (I4.32p - (]4.35p gives 

P{Mn > Vnx,A^ = o(l)e-^'. (4.36) 

Define 

n 

A, = {\Y.^k^''^'\ ^ xy/n{l + en/x^)], l<j<q. 



k=l 



We have 

q 

p(m„ > x^MiTTj^) > J2 P(^j) - E P(^«^i)- 

j=i i<i<j<q 

By Lemma 14.21 (ii), we have 

P(A,) = (1 + o(l))e-^^ P(A,A,) = 2-1(1 + o(l))e-2-^ 
uniformly in x G [4, e^n^/^] and 1 < i,j < q. This shows that 

p(m„ > a;v/ri(l + £„/a;2)) > (1 + o(l))ge-^''(l - 2-ige-"'). (4.37) 
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It follows from fOB . (O^ and (I07|) that 

p(m„ > xK) > (1 + o(l))ge-^'(l - 2~ige-^'). (4.38) 

uniformly in a; G [4, e^n^/^]. Let x = y/y + log q. Combining (14.291) and (14.381) . we 
have for any fixed M > 0, 



lim sup sup 



P(^-logg>y 



1 - exp(-exp(-2/)) 
For - logg < y < M, by ([HI]), KT8\f and fl419|) . 



< Ce 



-M 



lim sup sup 

n^oo — log (?<?/< A/ 



P(^-logg>y 



1 - exp(-exp(-y)) 
This proves Theorem 2.3 by flCTj) and flOOD . □ 



0. 



(4.39) 



(4.40) 



Proof of Lemma 3.1. This lemma follows immediately by Theorem 2.3 and 
/„((x + logg)/g) 



^9 2^j=llni(^i 



where {X^} are i.i.d. A^(0, 1) random variables. □ 



Proof of Theorem 3.1. Let Cg = {Pg < ^/(3G), "'^ > 0/{2G)} and define 
F{x) = exp(— exp(— x)). Let x„ satisfy 1 — -F(x„) = 9/{2.5G). So x„ ~ logG. 
Corollary 3.1 yields 

1 - F(Xr, 



max — ^—^ — TTT-l =o(l). (4.41) 

i<g<G 1 -Fn,g{{xn + log q)/q) ^ ' ^ ' 

By (I4.4ip and the definition of x„, we can see that on Cg, it holds P^™^ > 6/{2G) > 
1 — Fn,g{{xn + logg)/g) for n large. By the monotonicity of distribution function we 
have qfg — logg < Xn- This together with Corollary 3.1 and Lemma 3.1 yields 



max 

1<9<G 



Pn 



ptrue 
9 



l{Cg} = 0(1). 



Note that on Hg f] we have Pg > 0/ (3G). We can show that qfg — log q < i/n, where 
1 — Fiijn) = 9/{4:G), so i/n ~ logG. In fact, by Lemma 3.1, 

fn{q~\yn + log q)) . _ 

and hence, /„(/g) = Pg > /n(g"^(z/n + logg)) for n large, which implies qfg-logq < Vn- 
It follows from Corollary 3.1 and Lemma 3.1 that 



max 

1<S<G 



Pn 



ptrue 
9 



m9}m} = 



The theorem is proved. □ 
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